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Abstract 

Let iV be a finitely generated nilpotent group. Algorithm is con- 
structed such, that for every automorphism <p £ Aut(N) defines the Rei- 
dmeister number R(ifi). It is proved that any free nilpotent group of rank 
r = 2 or 3 and class c > 4r, or rank r > 4 and class c > 2r, belongs to the 
class Roo. 
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1 Introduction 

Let if : G — > G be an automorphism of a group G. One says that the elements 
g,f G G are ip— twisted conjugated, denoted by g ~ v /, if and only if there 
exists x £ G such that g = (xip)^ 1 fx, or equivalently (x<p)g = fx. A class of 
equivalence [g] v is called the Reidemeister class (or the tp— conjugacy class of 
ip). The number R(tp) of Reidemeister classes is called the Reidemeister number 
of (p. 
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There are different origins of interest in twisted conjugacy relations. In 
classical Nielsen-Reidemeister fixed point theory, R(<p) plays a crucial role in 
estimating the Nielsen number N(f) of a selfmap / : C — * C, where C is a 
compact connected manifold. In such setting ip appears as the homomorphism 
induced by / on the fundamental group -K\{C). The Nielsen number N(f) is a 
homotopy invariant which provides a lower bound of size of the set Fix / (C) of 
fixed /—points. The Selberg theory (see [16]), and Algebraic Geometry (see [9]) 
present other sources for the twisted conjugacy relations. 

One of the central problems in the field concerns obtaining a twisted analogue 
of the classical Burnsidc-Frobcnius theorem, that to show the coincidence of 
the Reidemeister number R(ip) and the number of fixed points of the induced 
homeomorphism of an appropriate dual object. The authors of the paper [6] 
emphasize that one step in this process is to describe the class of groups G, such 
that R(ip) = oo for any automorphism ip : G — > G. In a number of papers (|19j. 
[5], [6]) this class of groups is denoted R^. Namely, a group G has property Roo 
(or is an R^ group) if all of its automorphisms ip have R(tp) = oo. 

It was shown by various authors that the following groups belong to the class 

Roc ■ 

• non-elementary Gromov hyperbolic groups [141 [5] ; 

• Baumslag-Soliter groups B(m,n) except for B(l,l) [J]; 

• generalized Baumslag-Soliter groups, that is finitely generated groups which 
act on a tree with all edge and vertex stabilizers infinite cyclic [131 HZ] ; 

• lamplighter groups Z„iurZ if and only if 2|n or 3|n [S]; 

• the solvable generalization T of BS(l, n) given by the short sequence 1 — *• 
Z[l/n]^r^Z fc ^l US]; 

• relatively hyperbolic groups [3]; 

• the Grigorchuk group and Gupta-Sidki group [6]. 

For the immediate consequences of R^ property for topological fixed point 
theory see, e.g. [T7] , 

In the present paper we treat with finitely generated nilpotent groups. On 
the first glance nilpotent groups are too far to possess the i?oo property Indeed, 
E.G. Kukina [12] noted that the Reidemeister spectrum 

Spec R (G) = {R{p)\p G Aut(G)} 

of any free abelian group G = Z fc , k > 2, coincides with N U {oo}, i.e. is full. 

She also calculated the Reidemeister spectrums of the free nilpotent groups 
N rc of rank r and class c in cases r = 2, 3 and c = 2. Namely, 



Spec R (N 22 ) = {2k\k G N} U {oo}, 



Twisted conjugacy classes in nilpotent groups 



3 



Spec R {N 32 ) = {2k + l\k £ N} U {4k\k £ N} U {cx)}. 



Note that the occurrence of any even number in Speci? (-/V22) was established 
by F.K. Indukaev [TD]. 

2 The representatives of the twisted conjugacy 
classes 

Let G be any finitely generated group, and let C be a central subgroup of G. 
For any automorphism ip : G — > G define a central subgroup 



Lemma 2.1. .Am/ pair of elements C\,C2 £ C are (p~ conjugated in G if and 
only if 



Corollary 2.2. The set of all ip— conjugacy classes of the elements c £ C 
coincides with the set of all cosets C w.r.t. L(C, ip). In particular, R(<p) > [C : 



Corollary 2.3. In the case of a finitely generated abelian group G = C there 
is an effective procedure for calculating the Reidcmeister number R(<p) of any 
automorphism ip : G — > G. Moreover, such procedure finds in a finite case a set 
of representatives of all (p— conjugacy classes. 

Proof. Let G = gp(a\, ...,a p ), and aitp = Cj<2j, i = I,..., p. Then L(C,ip) = 
gp(ci, ...,c p ). A standard procedure easily defines either [C : L(C,tp)] = 00, or 
not. 

In a finite case we just need to calculate the index [C : L(C, (p)} and to find 
any transversal set of C w.r.t. L(C,ip). It is well known that such effective 
procedure exists in any finitely generated effective presented abelian group G. 

Now let G be any group, and ip : G — > G be an automorphism of G. Let C 
be a central ip— admissible subgroup of G. Denote by 77 : G — > G = G/C the 
standard cpimorphism, and by tp : G — » G the induced by 99 automorphism. Let 
\g\ip be any yj— conjugacy class in G, and (7 £ G be any pre image of g in G. Define 
an automorphism ip g : G — > G by <^ g = poa g , where cr g £ InnG, o~ g : /i 1— > g~ l hg 
for all h E G. Define as before a subgroup L(G, <p g ) of G. Then we have 



i(G, </?) = {c £ G|3x £ G\xp = cx}. 



(1) 




L(G,^)]. 
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Lemma 2.4. The full pre image in G under the standard epimorphism 77 : G — > 
G of any (p— equivalence class [g]^ is a disjoint union of s = [C : L(C,tp g )] 
if— conjugacy classes 

[gc^U ...U[gc s ] v , (3) 
where {ci,...,c s } is any transversal set of C w.r.t. L(C,tp g ). 

Proof. Let we show first that all <p— conjugacy classes in © arc different. 
Suppose that gci ^ v gcj for some i ^ j. Then 

3x G G\(xip)ga = gejX => (xtp g ) — cT CjX => cT Cj G L(C, ip g ), (4) 

which contradicts to our assumption. 

Now we are to prove that every element gc, c G C, is ^—conjugated to some 
of gci,i = 1, ...,c s . Namely, if c = qc', where c' G L(C,ip g ) then gc ~ v gci. To 
prove it suppose that for x G G one has xtp g = c'x. Then 

xtp = g(xip g )g~ 1 = gxg^c' (xtp)gci = gcic'x =>■ gc ~ v gcj. (5) 
At last suppose that any element / G G belongs to the full pre image of [g]cp- 

So, 



/ ~v 9 => 3x e G,c e C\{xip)g = fxc {xip)gc 1 = fx =>• / ~ v ga, (6) 

where c _1 = c,;c', d G L(C, tp g ). 

The following result was obtained in [15j even in more general form. 

Lemma 2.5. Let N be a finitely generated nilpotent group of class k, and ip : 
N — > N be any automorphism. Then there is an effective procedure which gives 
a finite generating set of a subgroup 

Fix v (N) = {x G N\xip = x}. (7) 

Proof. Obviously, such procedure exists in abelian case k = 1. 

Let C be a central ^—admissible subgroup of N, one can take the last non- 
trivial member C — -f^-iN of the lower central scries of N. Let <p : N/C — > N/C 
be the induced by tp automorphism. By induction on k we have a generating 
set of 

Fix^N/C)=gp(g- u ...,g l ). (8) 

Then we can effectively obtain a generating set {gi, ...,gi, gi+i, g p } of the 
full pre image of Fix^(N/C) in N. Namely, we take some pre images gi, ...,gi 
of the elements g\, .. .,<?;, respectively, and add a generating set {gi+i, g P } of 
C. See for details [11] ■ So, 



= Cj^j, i = 1, ...,p. 



(9) 
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Introduce a homomorphism of the full pre image of Fix^ ( TV/ C) in TV to C, 
uniquely defined by the map 

fj,:gi^Ci,i=l,...,p. (10) 

Since the derived subgroup belongs to kerfi wc actually have a homomor- 
phism of abclian groups. Then we can effectively find a generating set of 

Fix v {N) = kern. (11) 



Theorem 1. Let iV be a finitely generated nilpotent group of class k. Then 
there is an effective procedure to calculate for any automorphism ip : TV — > TV 
the Reidemcistcr number R(<p). 

Proof. By induction on fc, starting with Corollary 12.31 we can assume that 
the statement is true for any finitely generated nilpotent group of class < k — 1. 

Let ip : TV — ► TV be any automorphism of TV. Consider some (f— admissible 
central scries 

N = C 1 >C 2 > ... >C k >l. (12) 

For example, one can take the lower central series in TV. The automorphism tp 
induces the automorphisms (fi : TVj — > TV, where TV = TV/Cj+i, i = 1, k — 1. 

By induction we have the number R(ifk~i). Obviously, R(<fk-i) = oo implies 
i?(v? fc ) = i?(^) = oo. 

Suppose, R(ipk-i) = t < oo. Let 

[ffi]<p fc -i,-,[ffrW-i (13) 

be the set of all (fk-i —conjugacy classes in TVfe_i = N/Ck- As before / means 
the image of any element / € TV under the standard epimorphism TV — > TVfe_i. 

To apply Lemma 12.41 we need in subgroups L(Ck,ip gi ), i = l,...,r. Let 

?/.> : TV — > TV be any automorphism with ^(Cfc) = Cfcj an d ipk-i '■ -^Vfe-i — * iVfe i 

be the automorphism induced by ip. 

Firstly we derive by Lemma \2. 51 a generating set of the full pre 

image of Fix^ k l (Nk-i) in TV. Then wc compute 

fj^ = Cjfj, <-j eC fc , j = l,...,q, (14) 

and conclude that 

L(C k ,ip) = gp(ci,...,c g ). (15) 

We repeat such process for every ij) = ip gi , i = 1, r. Every time we apply 
Lemma l2~4l to find a presentation of the full pre image H lflg . of [<7i] Vfc _ 1 in TV as 
a disjoint union of if— conjugacy classes in TV. The union of them is the set of 
all (,9— conjugacy classes in TV. 

Theorem is proved. 
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3 Most of the free nilpotent groups are in it^ 

Let TV be a finitely generated torsion free nilpotent group. Every quotient 
M = 0+iN/(iN, i = 0, 1, k — 1, of the upper central series 

CoN = 1< CiTV < ... < CfciV = TV (16) 

is a free abelian group of a finite rank. Any automorphism tp : TV — > TV induces 
the automorphisms tpi : TV, — > TV,, where TV; = N/&N, i = 1, ...,k — 1, as well 
as the automorphisms ^ : — > Aj, i = 0, 1, k - 1. 

Lemma 3.1. Let A be a free abelian group of a finite rank r. Let tp : A — > A be 
any automorphism of A such that 

Fix v A ^ 1. (17) 

Then R(tp) = oo. 

Proof. It was shown in Lemma \2. II that R(ip) = [A : L(A,tp)], where in our 
case 



L(A,(p) = im(<p - id). (18) 

The subgroup L(A, <p) is a free abelian group of rank s = range((p — id). If 
Fix v (A) / 1 we have s < r and so [A : L(A, ip)] = oo. 

Corollary 3.2. Let TV be a finitely generated torsion free nilpotent group of 
class k, and tp : TV — ► TV be any automorphism of TV. Suppose that Fix^ i (Ai) ^ 1 
for some i = 0, 1, k — 1. Then R(tp) = oo. 

Proof. We can assume that i is maximal with property Fix t p i (Ai) ^ 1. Then 
Fix ipi+1 = 1. Let in the denotions of Lemma [2.11 G = Ni and C = Ai. Then by 
the statement of Lemma |3. II R(tOi) = oo, so R{tpi) — oo too. 

E. Formanek [7] classified all pairs r, c for which the free nilpotent group TV rc 
of rank r > 2 and class c > 2 has nontrivial elements fixed by all automorphisms. 
Note that V. Bludov (see pQ, background to Problem NI by A. Myasnikov) gave 
the first examples of such elements for r = 2, c = 4k, k > 2. 

Theorem of Formanek. Let TV rc be a free nilpotent group of rank r 
and class c. Then there are nontrivial elements of TV rc which are fixed by all 
automorphisms of TV rc if and only if 

(a) r = 2 or r = 3, and c = 2kr, k > 2. 

(b) r > 4 and c = 2fcr, k > 1. 

This remarkable result allows to define place of most free nilpotent groups 
of finite rank in the class i?oo- 

Theorem 2. Let TV rc be a free nilpotent group of rank r > 2 and class 
c > 2. Suppose that for r = 2 or r = 3 we have c > 4r and for r > 4 we have 
c > 2r. Then TV rc € Roc- 
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Proof. Denote N = N rc . Let ip : N — > N be any automorphism. It follows 
from the Formanek's theorem that there is a maximal k such that the induced 
automorphism <pj : Nj — * iV} has Fix Vj (Nj) ^ 1. Then Fix^AAj) ^ 1, and so 
by Lemma [2.11 R(lpj) = oo. By Corollary 13.21 we have = oo, which gives 

the conclusion of the theorem. 
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